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Background of the Invention 

This invention relates generally to 
semiconductor electrically erasable programmable read 
only memories (EEprom), and specifically to a system of 
integrated circuit Flash EEprom chips. 

Computer systems typically use magnetic disk 
drives for mass storage of data. However, disk drives 
are disadvantageous in that they are bulky and in their 
requirement for high precision moving mechanical parts. 
Consequently they are not rugged and are prone to 
reliability problems, as well as consuming significant 
amounts of power. Solid state memory devices such as 
DRAM's and SRAM's do not suffer from these 
disadvantages. However, they are much more expensive, 
and require constant power to maintain their memory 
(volatile) . Consequently, they are typically used as 
temporary storage. 

EEprom' s and Flash EEprom' s are also solid 
state memory devices. Moreover, they are nonvolatile, 
and retain their memory even after power is shut down. 
However, conventional Flash EEprom 's have a limited 
lifetime in terms of the number of write (or 
program) /erase cycles they can endure. Typically the 
devices are rendered unreliable after 10 2 to 10 3 
write/erase cycles. Traditionally, they are typically 
used in applications where semi-permanent storage of 
data or program is required but with a limited need for 
reprogramming . 



Accordingly, it is an object of the present 
invention to provide a Flash EEprom memory system with 
enhanced performance and which remains reliable after 
enduring a large number of write/erase cycles. 

It is another object of the present invention 
to provide an improved Flash EEprom system which can 
serve as non-volatile memory in a computer system. 

It is another object of the present invention 
to provide an improved Flash EEprom system that can 
replace magnetic disk storage devices in computer 
systems . 

It is another object of the present invention 
to provide a Flash EEprom system with improved erase 
operation. 

It is another object of the present invention 
to provide a Flash EEprom system with improved error 
correction. 

It is yet another object of the present 
invention to provide a Flash EEprom with improved write 
operation that minimizes stress to the Flash EEprom 
device. 

It is still another object of the present 
invention to provide a Flash EEprom system with enhanced 
write operation. 

Summary of the Invention 

These and additional objects are accomplished 
by improvements in the architecture of a system of 
EEprom chips, and the circuits and techniques therein. 

According to one aspect of the present 
invention, an array of Flash EEprom cells on a chip is 
organized into sectors such that all cells within each 
sector are erasable at once. A Flash EEprom memory 
system comprises one or more Flash EEprom chips under 
the control of a controller. The invention allows any 
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combination of sectors among the chips to be selected 
and then erased simultaneously. This is faster and more 
efficient than prior art schemes where all the sectors 
must be erased every time or only one sector at a time 
5 can be erased. The invention further allows any 
combination of sectors selected for erase to be 
deselected and prevented from further erasing during the 
erase operation. This feature is important for stopping 
those sectors that are first to be erased correctly to 

10 the "erased" state from over erasing, thereby preventing 
unnecessary stress to the Flash EEprom device. The 
invention also allows a global de-select of all sectors 
in the system so that no sectors are selected for erase. 
This global reset can quickly put the system back to its 

15 initial state ready for selecting the next combination 
of sectors for erase. Another feature of the invention 
is that the selection is independent of the chip select 
signal which enables a particular chip for read or write 
operation. Therefore it is possible to perform an erase 

2 0 operation on some of the Flash EEprom chips while read 

and write operations may be performed on other chips not 
involved in the erase operation. 

According to another aspect of the invention, 
improved error correction circuits and techniques are 
25 used to correct for errors arising from defective Flash 
EEprom memory cells. One feature of the invention 
allows defect mapping at cell level in which a defective 
cell is replaced by a substitute cell from the same 
sector. The defect pointer which connects the address 

3 0 of the defective cell to that of the substitute cell is 

stored in a defect map. Every time the defective cell 
is accessed, its bad data is replaced by the good data 
from the substitute cell. 

Another feature of the invention allows defect 
35 mapping at the sector level. When the number of 



+ • 



4 

defective cells in a sector exceeds a predetermined 
number, the sector containing the defective cells is 
replaced by a substitute sector. 

An important feature of the invention allows 
defective cells or defective sectors to be remapped as 
soon as they are detected thereby enabling error 
correction codes to adequately rectify the relatively 
few errors that may crop up in the system. 

According to yet another aspect of the present 
invention , a write cache is used to minimize the number 
of writes to the Flash EEprom memory. In this way the 
Flash EEprom memory will be subject to fewer stress 
inducing write/erase cycles, thereby retarding its 
aging. The most active data files are written to the 
cache memory instead of the Flash EEprom memory. Only 
when the activity levels have reduced to a predetermined 
level are the data files written from the cache memory 
to the Flash EEprom memory. Another advantage of the 
invention is the increase in write throughput by virtue 
of the faster cache memory. 

According to yet another aspect of the present 
invention , one or more printed circuit cards are 
provided which contain controller and EEprom circuit 
chips for use in a computer system memory for long term, 
non-volatile storage, in place of a hard disk system, 
and which incorporate various of the other aspects of 
this invention alone and in combination. 

Additional objects, features, and advantages of 
the present invention will be understood from the 
following description of its preferred embodiments, 
which description should be taken in conjunction with 
the accompanying drawings. 
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Brief Description of the Drawings 

Fig. 1A is a general micrprocessor system 
including the Flash EEprom memory system of the present 
invention; 

5 Fig. IB is schematic block diagram illustrating 

a system including a number of Flash EEprom memory chips 
and a controller chip; 

Fig. 2 is a schematic illustration of a system 
of Flash EEprom chips, among which memory sectors are 
10 selected to be erased; . cm * Ho-i^ ^ "T 

Fig. 3A is a block circuit diagram (in the 
controller^ for implementing selective multiple sector 
erase according to the preferred embodiment; 

Fig. 3B shows details of a typical register 
15 used to select a sector for erase as shown in Fig. 2A; 

Fig. 4 is a flow diagram illustrating the erase 
sequence of selective multiple sector erase; 

Fig. 5 is a schematic illustration showing the 
partitioning of a Flash EEprom sector into a data area 
20 and a spare redundant area; 

Fig. 6 is a circuit block diagram illustrating 
the data path control during read operation using the 
defect mapping scheme of the preferred embodiment; 

Fig. 7 is a circuit block diagram illustrating 
25 the data path control during the write operation using 
the defect mapping scheme of the preferred embodiment; 

Fig. 8 is a block diagram illustrating the 
write cache circuit inside the controller. 
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Description of the Preferred Embodiments 
EEprom System 

A computer system in which the various aspects 
of the present invention are incorporated is illustrated 
5 generally in Figure 1A. A typical computer system 
architecture includes a microprocessor 21 connected to 
a system bus 23, along with random access, main system 
memory 25, and at least one or more input-output devices 
27, such as a keyboard, monitor, modem, and the like. 

10 Another main computer system component that is connected 
to a typical computer system bus 23 is a large amount of 
long-term, non-volatile memory 29. Typically, such a 
memory is a disk drive with a capacity of tens of 
megabytes of data storage. This data is retrieved into 

15 the system volatile memory 25 for use in current 
processing, and can be easily supplemented, changed or 
altered. 

One aspect of the present invention is the 
substitution of a specific type of semiconductor memory 

2 0 system for the disk drive but without having to 
sacrifice non-volatility, ease of erasing and rewriting 
data into the memory, speed of access, low cost and 
reliability. This is accomplished by employing an array 
of electrically erasable programmable read only memories 

25 (EEprom's) integrated circuit chips. This type of 
memory has additional advantages of requiring less power 
to operate, and of being lighter in weight than a hard 
disk drive magnetic media memory, thereby being 
especially suited for battery operated portable 

30 computers. 

The bulk storage memory 29 is constructed of a 
memory controller 31, connected to the computer system 
bus 23, and an array 3 3 of EEprom integrated circuit 
chips. Data and instructions are communicated from the 

35 controller 31 to the EEprom array 33 primarily over a 



serial data line 35. Similarly, data and status signals 
are communicated from the EEprom 33 to the controller 31 
over serial data lines 37. Other control and status 
circuits between the controller 31 and the EEprom array 
33 are not shown in Figure 1A. 

Referring to Figure IB, the controller 31 is 
preferably formed primarily on a single integrated 
circuit chip. It is connected to the system address and 
data bus 39, part of the system bus 33, as well as being 
connected to system control lines 41, which include 
interrupt, read, write and other usual computer system 
control lines. 

The EEprom array 33 includes a number of EEprom 
integrated circuit chips 43, 45, 47, etc. Each includes 
a respective chip select and enable line 49, 51 and 53 
from interface circuits 40. The interface circuits 40 
also act to interface between the serial data lines 35, 
37 and a circuit 55. Memory location addresses and data 
being written into or read from the EEprom chips 43, 45, 
47, etc. are communicated from a bus 55, through logic 
and register circuits 57 and thence by another bus 59 to 
each of the memory chips 43, 45, 47 etc. 

The bulk storage memory 29 of Figures 1A and IB 
can be implemented on a single printed circuit card for 
moderate memory sizes. The various lines of the system 
buses 39 and 41 of Figure IB are terminated in 
connecting pins of such a card for connection with the 
rest of the computer system through a connector. Also 
connected to the card and its components are various 
standard power supply voltages (not shown) . 

For large amounts of memory, that which is 
conveniently provided by a single array 33 may not be 
enough. In such a case, additional EEprom arrays can be 
connected to the serial data lines 35 and 37 of the 
controller chip 31, as indicated in Figure IB. This is 
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preferably all done on a single printed circuit card but 
if space is not sufficient to do this, then one or more 
EEprora arrays may be implemented on a second printed 
circuit card that is physically mounted onto the first 
and connected to a common controller chip 31. 

Erase of Memory Structures 

In system designs that store data in files or 
blocks the data will need to be periodically updated 
with revised or new information. It may also be 
desirable to overwrite some no longer needed 
information, in order to accommodate additional 
information. In a Flash EEprom memory, the memory cells 
must first be erased before information is placed in 
them. That is, a write (or program) operation is always 
preceded by an erase operation. 

In conventional Flash erase memory devices, the 
erase operation is done in one of several ways. For 
example, in some devices such as the Intel corporation's 
model 27F-256 CMOS Flash EEprom, the entire chip is 
erased at one time. If not all the information in the 
chip is to be erased, the information must first be 
temporarily saved, and is usually written into another 
memory (typically RAM) . The information is then 
restored into the nonvolatile Flash erase memory by 
programming back into the device. This is very slow and 
requires extra memory as holding space. 

In other devices such as Seeg Technology 
Incorporated ' s model 48512 Flash EEprom chip, the memory 
is divided into blocks (or sectors) that are each 
separately erasable, but only one at a time. By 
selecting the desired sector and going through the erase 
sequence the designated area is erased. While, the need 
for temporary memory is reduced, erase in various areas 
of the memory still requires a time consuming sequential 



approach . 

In the present invention, the Flash EEprom 
memory is divided into sectors where all cells within 
each sector are erasable together. Each sector can be 
addressed separately and selected for erase. One 
important feature is the ability to select any 
combination of sectors for erase together. This will 
allow for a much faster system erase than by doing each 
one independently as in prior art. 

Figure 2 illustrates schematically selected 
multiple sectors for erase. A Flash EEprom system 
includes one or more Flash EEprom chips such as 201, 
203, 205. They are in communication with a controller 
31 through lines 209. Typically, the controller 31 is 
itself in communication with a microprocessor system 
(not shown). The memory in each Flash EEprom chip is 
Partitioned into sectors where all memory cells within 
a sector are erasable together. For example, each 
sector may have 512 byte (i.e. 512x8 cells) available to 
the user, and a chip may have 1024 sectors. Each sector 
is individually addressable, and may be selected, such 
as sectors 211, 213, 215, 217 in a multiple sector 
erase. As illustrated in figure 2, the selected sectors 
may be confined to one EEprom chip or be distributed 
among several chips in a system. The sectors that were 
selected will all be erased together. This capability 
will allow the memory and system of the present 
invention to operate much faster than the prior art 
architectures . 

Figure 3A illustrates a block diagram circuit 
220 on a Flash EEprom chip (such as the chip 201 of 
figure 2) with which one or more sectors such as 211, 
213 are selected (or deselected) for erase. 
Essentially, each sector such as 211, 213 is selected or 
tagged by setting the state of an erase enable register 
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such as 221, 223 associated with the respective sectors. 
The selection and subsequent erase operations are 
performed under the control of the controller 31 (see 
figure 2) . The circuit 220 is in communication with the 
controller 31 through lines 209. Command information 
from the controller is captured in the circuit 220 by a 
command register 225 through a serial interface 227. It 
is then decoded by a command decoder 229 which outputs 
various control signals. Similarly, address information 
is captured by an address register 231 and is decoded by 
an address decoder 233. 

For example, in order to select the sector 211 
for erase, the controller sends the address of the 
sector 211 to the circuit 220. The address is decoded 
in line 235 and is used in combination with a set erase 
enable signal in bus 237 to set an output 239 of the 
register 221 to HIGH. This enables the sector 211 in a 
subsequent erase operation. Similarly, if the sector 
213 is also desired to be erased, its associated 
register 223 may be set HIGH. 

Figure 3B shows the structure of the register 
such as 221, 223 in more detail. The erase enable 
register 221 is a SET/RESET latch. Its set input 241 is 
obtained from the set erase enable signal in bus 237 
gated by the address decode in line 235. Similarly, the 
reset input 243 is obtained from the clear erase enable 
signal in bus 237 gated by the address decode in line 
235. In this way, when the set erase enable signal or 
the clear erase enable signal is issued to all the 
sectors, the signal is eiffective only on the sector that 
is being addressed. 

After all sectors intended for erase have been 
selected, the controller then issues to the circuit 22 0, 
as well as all other chips in the system a global erase 
command in line 251 along with the high voltage for 
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erasing in line 209. The device will then erase all the 
sectors that have been selected (i.e. the sectors 211 
and 213) at one time. In addition to erasing the 
desired sectors within a chip, the architecture of the 
present system permits selection of sectors across 
various chips for simultaneous erase. 

Figures 4 (1) -4 (11) illustrate the algorithm 
used in conjunction with the circuit 220 of figure 3A. 
In figure 4(1), the controller will shift the address 
into the circuit 220 which is decoded in the line to the 
erase enable register associated with the sector that is 
to be erased. In figure 4(2), the controller shifts in 
a command that is decoded to a set erase enable command 
which is used to latch the address decode signal onto 
the erase enable register for the addressed sector. 
This tags the sector for subsequent erase. In figure 
4(3), if more sectors are to be tagged, the operations 
described relative to figures 4(1) -4 (2) are repeated 
until all sectors intended for erase have been tagged. 
After all sectors intended for erase have been tagged, 
the controller initiates an erase cycle as illustrated 
in figure 4 (4) . 

Optimized erase implementations have been 
disclosed in two copending U.S. patent applications. 
They are copending U.S. patent applications, Serial No. 
204,175, filed June 8, 1988, by Dr. Eliyahou Harari and 
one entitled "Multi-State EEprom Read and Write Circuits 
and Techniques," filed on the same day as the present 
application, by San jay Mehrotra and Dr. Eliyahou Harari. 
The disclosures of the two applications are hereby 
incorporate by reference. The Flash EEprom cells are 
erased by applying a pulse of erasing voltage followed 
by a read to verify if the cells are erased to the 
"erased" state. If not, further pulsing and verifying 
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are repeated until the cells are verified to be erased. 
By erasing in this controlled manner, the cells are not 
subject to over-erasure which tends to age the EEprom 
device prematurely as well as make the cells harder to 
program. 

As the group of selected sectors is going 
through the erase cycle, some sectors will reach the 
"erase" state earlier than others. Another important 
feature of the present invention is the ability to 
remove those sectors that have been verified to be 
erased from the group of selected sectors, thereby 
preventing them from over-erasing. 

Returning to figure 4(4), after all sectors 
intended for erase have been tagged, the controller 
initiates an erase cycle to erase the group of tagged 
sectors. In figure 4 (5) , the controller shifts in a 
global command called Enable Erase into each Flash 
EEprom chip that is to perform an erase. This is 
followed in figure 4(5) by the controller raising of the 
erase voltage line (Ve) to a specified value for a 
specified duration. The controller will lower this 
voltage at the end of the erase duration time. in 
figure 4(6), the controller will then do a read verify 
sequence on the sectors selected for erase. m figure 
4(7) , if none of the sectors are verified, the sequences 
illustrated in figures 4 (5) -4 (7) are repeated. in 
figures 4(8) and 3(9), if one or more sectors are 
verified to be erased, they are taken out of the 
sequence. Referring also to figure 3A, this is achieved 
by having the controller address each of the verified 
sectors and clear the associated erase enable registers 
back to a LOW with a clear enable command in bus 237. 
The sequences illustrated in figures 4 (5) -4 (10) are 
repeated until all the sectors in the group are verified 
to be erased in figure 4(11). At the completion of the 



m m 



13 

erase cycle, the controller will shift in a No Operation 
(NOP) command and the global Enable Erase command will 
be withdrawn as a protection against a false erasure. 

The ability to select which sectors to erase 
and which ones not to, as well as which ones to stop 
erasing is advantageous. It will allow sectors that 
have erased before the slower erased sectors to be 
removed from the erase sequence so no further stress on 
the device will occur. This will increase the 
reliability of the system. Additional advantage is that 
if a sector is bad or is not used for some reason, that 
sector can be iskipped over with no erase occurring 
within that sector. For example, if a sector is 
defective and have shorts in it, it may consume much 
power. A significant system advantage is gained by the 
present invention which allows it to be skipped on erase 
cycles so that it may greatly reduce the power required 
to erase the chip. 

Another consideration in having the ability to 
pick the sectors to be erased within a device is the 
power savings to the system. The flexibility in erase 
configuration of the present invention enables the 
adaptation of the erase needs to the power capability of 
the system. This can be done by configuring the systems 
to be erased differently by software on a fixed basis 
between different systems. It also will allow the 
controller to adaptively change the amount of erasing 
being done by monitoring the voltage level in a system, 
such as a laptop computer. 

An additional performance capability of the 
system in the present invention is the ability to issue 
a reset command to a Flash EEprom chip which will clear 
all erase enable latches and will prevent any further 
erase cycles from occurring. This is illustrated in 
figures 2A and 2B by the reset signal in the line 261. 



14 

By doing this in a global way to all the chips, less 
time will be taken to reset all the erase enable 
registers. 

An additional performance capability is to have 
the ability to do erase operations without regard to 
chip select. Once an erase is started in some of the 
memory chips, the controller in the system can access 
other memory chips and do read and write operations on 
them. In addition, the device (s) doing the erase can be 
selected and have an address loaded for the next command 
following the erase. 

Defect Mapping 

Physical defects in memory devices give rise to 
hard errors. Data becomes corrupted whenever it is 
stored in the defective cells. In conventional memory 
devices such as RAM's and Disks, any physical defects 
arising from the manufacturing process are corrected at 
the factory. In RAM's, spare redundant memory cells on 
chip may be patched on, in place of the defective cells. 
In the traditional disk drive, the medium is imperfect 
and susceptible to defects. To overcome this problem 
manufacturers have devised various methods of operating 
with these defects present, the most usual being defect 
mapping of sectors. In a normal disk system the media 
is divided into cylinders and sectors. The sector being 
the basic unit in which data is stored. When a system 
is partitioned into the various sectors the sectors 
containing the defects are identified and are marked as 
bad and not to be used by the system. This is done in 
several ways. A defect map table is stored on a 
particular portion of the disk to be used by the 
interfacing controller. In addition, the bad sectors 
are marked as bad by special ID and flag markers. When 
the defect is addressed, the data that would normally be 



# # 

15 

stored there is placed in an alternative location. The 
requirement for alternative sectors makes the system 
assign spare sectors at some specific interval or 
location. This reduces the amount of memory capacity 
and is a performance issue in how the alternative 
sectors are located. 

One important application of the present 
invention is to replace a conventional disk storage 
device with a system incorporating an array of Flash 
EEprom memory chips. The EEprom system is preferably 
set up to emulate a conventional disk, and may be 
regarded as a "solid-state disk". 

In a "disk" system made from such solid-state 
memory devices, low cost considerations necessitate 
efficient handling of defects. Another important 
feature of the invention enables the error correction 
scheme to conserve as much memory as possible. 
Essentially, it calls for the defective cells to be 
remapped cell by cell rather than by throwing away the 
whole sector (512 bytes typically) whenever a defect 
occurs in it. This scheme is especially suited to the 
Flash EEprom medium since the majority of errors will be 
bit errors rather than a long stream of adjacent defects 
as is typical in traditional disk medium. 

In both cases of the prior art RAM and magnetic 
disk, once the device is shipped from the factory/ there 
is little or no provision for replacing hard errors 
resulting from physical defects that appear later during 
normal operation. Error corrections then mainly rely on 
schemes using error correction codes (ECC) . 

The nature of the Flash EEprom device 
predicates a higher rate of cell failure especially with 
increasing program/erase cycling. The hard errors that 
accumulate with use would eventually overwhelm the ECC 
and render the device unusable. One important feature 
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of the present invention is the ability for the system 
to correct for hard errors whenever they occur. 
Defective cells are detected by their failure to program 
or erase correctly. Also during read operation, 
defective cells are detected and located by the ECC. As 
soon as a defective cell is identified , the controller 
will apply defect mapping to replace the defective cell 
with a space cell located usually within the same 
sector. This dynamic correction of hard errors, in 
addition to conventional error correction schemes, 
significantly prolongs the life of the device. 

Another feature of the present invention is an 
adaptive approach to error, correction. Error correction 
code (ECC) is employed at all times to correct for soft 
errors as well as any hard errors that may arise. As 
soon as a hard error is detected, defect mapping is used 
to replace the defective cell with a spare cell in the 
same sector block. Only when the number of defective 
cells in a sector exceeds the defect mapping's capacity 
for that specific sector will the whole sector be 
replaced as in a conventional disk system. This scheme 
minimized wastage without compromising reliability. 

Figure 5 illustrates the memory architecture 
for the cell remapping scheme. As described before, the 
Flash EEprom memory is organized into sectors where the 
cells in each sector are erasable together. The memory 
architecture has a typical sector 401 organized into a 
data portion 403 and a spare (or shadow) portion 405. 
The data portion 403 is memory space available to the 
user. The spare portion 405 is further organized into 
an alternative defects data area 407, a defect map area 
409, a header area 411 and an ECC and others area 413. 
These areas contain information that could be used by 
the controller to handle the defects and other overhead 
information such as headers and ECC. 
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Whenever a defective cell is detected in the 
sector, a good cell in the alternative defects data area 
4 07 is assigned to backup the data designated for the 
defective cell. Thus even if the defective cell stores 
the data incorrectly , an error-free copy is stored in 
the backup cell. The addresses of the defective cell 
and the backup cell are stored as defect pointers in the 
defect map 409. 

It is to be understood that the partitioning 
between the user data portion 403 and the spare portion 
4 05 need not be rigid. The relative size of the various 
partitioned areas may be logically reassigned. Also the 
grouping of the various areas is largely for the purpose 
of discussion and not necessarily physically so. For 
example, the alternative defects data area 4 07 has been 
schematically grouped under the spare portion 4 05 to 
express the point that the space it occupies is no 
longer available to the user. 

In a read operation, the controller first reads 
the header, the defect map and the alternative defects 
data. It then reads the actual data. It keeps track of 
defective cells and the location of the substitute data 
by means of the defect map. Whenever a defective cell 
is encountered, the controller substitutes its bad data 
with the good data from the alternative defects. 

Figure 6 illustrates the read data path control 
in the preferred embodiment. A memory device 33 which 
may include a plurality of Flash EEprom chips is under 
the control of the controller 31. The controller 31 is 
itself part of a microcomputer system under the control 
of a microprocessor (not shown) . To initiate the 
reading of a sector, the microprocessor loads a memory 
address generator 503 in the controller with a memory 
address for starting the read operation. This 
information is loaded through a microprocessor interface 



18 

port 505. Then the microprocessor loads a DMA 
controller 507 with the starting location in buffer 
memory or bus address that the data read should be sent. 
Then the microprocessor loads the header information 
5 (Head, Cylinder and sector) into a holding register file 
509. Finally, the microprocessor loads a command 
sequencer 511 with a read command before passing control 
to the controller 31. 

After assuming control, the controller 31 first 
10 addresses the header of the sector and verifies that the 
memory is accessed at the address that the user had 
specified. This is achieved by the following sequence. 
The controller selects a memory chip (chip select) among 
the memory device 33 and shifts the address for the 
15 header area from the address generator 503 out to the 
selected memory chip in the memory device 33. The 
controller then switches the multiplexer 513 and shifts 
also the read command out to the memory device 33. Then 
the memory device reads the address sent it and begins 
sending serial data from the addressed sector back to 
the controller. A receiver 515 in the controller 
receives this data and puts it in parallel format. In 
one embodiment, once a byte (8 bits) is compiled, the 
controller compares the received data against the header 
25 data previously stored by the microprocessor in the 
holding register file 509. If the compare is correct, 
the proper location is verified and the sequence 
continues. 

Next the controller 31 reads the defect 
30 pointers and loads these bad address locations into the 
holding register file 509. This is followed by the 
controller reading the alternative defects data that 
were written to replace the bad bits as they were 
written. The alternative bits are stored in an 
3 5 alternative defects data file 517 that will be accessed 
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as the data bits are read. 

Once the Header has been determined to be a 
match and the defect pointers and alternative bits have 
been loaded, the controller begins to shift out the 
address of the lowest address of the desired sector to 
be read. The data from the sector in the memory device 
33 is then shifted into the controller chip 31. The 
receiver 515 converts the data to a parallel format and 
transfers each byte into a temporary holding FIFO 519 to 
be shipped out of the controller. 

A pipeline architecture is employed to provide 
efficient throughput as the data is gated through the 
controller from the receiver 515 to the FIFO 519. As 
each data bit is received from memory the controller is 
comparing the address of the data being sent (stored in 
the address generator 507) against the defect pointer 
map (stored in the register file 509) . if the address 
is determined to be a bad location, by a match at the 
output of the comparator 521, the bad bit from the 
memory received by the receiver 515 is replaced by the 
good bit for that location. The good bit is obtained 
from the alternative defects data file 517. This is 
done by switching the multiplexer 523 to receive the 
good bit from the alternative defects data file instead 
of the bad bit from the receiver 515, as the data is 
sent to the FIFO 519. Once the corrected data is in the 
FIFO it is ready to be sent to buffer memory or system 
memory (not shown) . The data is sent from the 
controller's FIFO 519 to the system memory by the 
controller's DMA controller 507. This controller 507 
then requests and gets access to the system bus and puts 
out an address and gates the data via an output 
interface 525 out to the system bus. This is done as 
each byte gets loaded into the FIFO 519. As the 
corrected data is loaded into the FIFO it will also be 
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gated into an ECC hardware 527 where the data file will 
be acted on by the ECC. 

Thus in the manner described, the data read 
from the memory device 33 is gated through the 
5 controller 31 to be sent to the system. This process 
continues until the last bit of addressed data has been 
transferred. 

In spite of defect mapping of previously 
detected defective cells, new hard errors might occur 

10 since the last mapping. As the dynamic defect mapping 
constantly "puts away" new defective cells, the latest 
hard error that may arise between defect mapping would 
be adequately handled by the ECC. As the data is gated 
through the controller 31, the controller is gating the 

15 ECC bits into the ECC hardware 527 to determine if the 
stored value matched the just calculated remainder 
value. If it matches then the data transferred out to 
the system memory was good and the read operation was 
completed. However, if the ECC registers an error then 

2 0 a correction calculation on the data sent to system 

memory is performed and the corrected data re- 
transmitted. The method for calculating the error can 
be done in hardware or software by conventional methods. 
The ECC is also able to calculate and locate the 

25 defective cell causing the error. This may be used by 
the controller 31 to update the defect map associated 
with the sector in which the defective cell is detected. 
In this manner, hard errors are constantly removed from 
the Flash EEprom system. 

30 Figure 7 illustrates the write data path 

control in the preferred embodiment. The first portion 
of a write sequence is similar to a read sequence 
described previously. The microprocessor first loads 
the Address pointers for the memory device 33 and the 

3 5 DMA as in the read sequence. It also loads the header 
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desired into the address generator 503 and the command 
queue into the command sequencer 511. The command queue 
is loaded with a read header command first. Thereafter, 
control is passed over to the controller 31. The 
5 controller then gates the address and command to the 
memory device 33, as in the read sequence. The memory 
device returns header data through controller's receiver 
515. The controller compares the received header data 
to the expected value (stored in the holding register 

10 file 509). If the compare is correct, the proper 
location is verified and the sequence continues. Then 
the controller loads the defective address pointers from 
the memory device 33 into the holding register file 509 
and the alternative data into the alternative defects 

15 data file 517. 

Next, the controller begins to fetch the write 
data from system memory (not shown) . It does this by 
getting access to the system bus, outputs the memory or 
bus address and does the read cycle. It pulls the data 

2 0 into a FIFO 601 through an input interface 603 . The 

controller then shifts the starting sector address 
(lowest byte address) from the address generator 503 to 
the selected memory device 33. This is followed by data 
from the FIFO 601. These data are routed through 
25 multiplexers 605 and 513 and converted to serial format 
before being sent to the memory device 33. This 
sequence continues until all bytes for a write cycle 
have been loaded into the selected memory. 

A pipeline architecture is employed to provide 

3 0 efficient throughput as the data is gated from the FIFO 

601 to the selected memory 33. The data gated out of 
the FIFO 601 is sent to the ECC hardware 527 where a 
remainder value will be calculated within the ECC. In 
the next stage, as the data is being sent to the memory 
35 device through multiplexers 605 and 513, the comparator 
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521 is comparing its address from the address generator 
503 to the defect pointer address values in the holding 
register file 509. When a match occurs, indicating that 
a defective location is about to be written, the 
5 controller saves this bit into the alternative defect 
data file 517. At the same time, all bad bits sent to 
memory will be sent as zeroes. 

After the bytes for a write cycle have been 
loaded into the selected memory device, the controller 

10 issues a program command to the memory device and 
initiate a write cycle. Optimized implementations of 
write operation for Flash EEprom device have been 
disclosed in two previously cited co-pending U.S. patent 
applications, Serial No. 204,175, and one entitled 

15 "Multi-State EEprom Read and Write Circuits and 
Techniques." Relevant portions of the disclosures are 
hereby incorporated by reference. Briefly, during the 
write cycle, the controller applies a pulse of 
programming (or writing) voltages. This is followed by 

20 a verify read to determine if all the bits have been 
programmed properly. If the bits did not verify, the 
controller repeats the program/ verify cycle until all 
bits are correctly programmed. 

If a bit fails to verify after prolonged 

25 program/verify cycling, the controller will designate 
that bit as defective and update the defect map 
accordingly. The updating is done dynamically, as soon 
as the defective cell is detected. Similar actions are 
taken in the case of failure in erase verify. 

3 0 After all the bits have been programmed and 

verified, the controller loads the next data bits from 
the FIFO 601 and addresses the next location in the 
addressed sector. It then performs another 

program/verify sequence on the next set of bytes. The 

35 sequence continues until the end of the data for that 
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sector. Once this has occurred, the controller 
addresses the shadow memory (header area) associated 
with the sector (see figure 5) and writes the contents 
of the ECC registers into this area. 
5 In addition, the collection of bits that was 

flagged as defective and were saved in the alternative 
defects data file 516 is then written in memory at the 
alternative defects data locations (see figure 5) , 
thereby saving the good bit values to be used on a 

10 subsequent read. Once these data groups are written and 
verified, the sector write is considered completed- 

The present invention also has provision for 
defect mapping of the whole sector, but only after the 
number of defective cells in the sector has exceeded the 

15 cell defect mapping's capacity for that specific sector. 
A count is kept of the number of defective cells in each 
sector. When the number in a sector exceeds a 
predetermined value, the controller marks that sector as 
defective and maps it to another sector. The defect 

2 0 pointer for the linked sectors may be stored in a sector 

defect map. The sector defect map may be located in the 
orginal defective sector if its spare area is 
sufficiently defect-free. However, when the data area 
of the sector has accumulated a large number of defects, 
25 it is quite likely that the spare area will also be full 
of defects. 

Thus, it is preferable in another embodiment to 
locate the sector map in another memory maintained by 
the controller. The memory may be located in the 

3 0 controller hardware or be part of the Flash EEprom 

memory. When the controller is given an address to 
access data, the controller compares this address 
against the sector defect map. If a match occurs then 
access to the defective sector is denied and the 
35 substitute address present in the defect map is entered, 



and the corresponding substitute sector is accessed 
instead. 

In yet another embodiment, the sector remapping 
is performed by the microprocessor. The microprocessor 
looks at the incoming address and compares it against 
the sector defect map. If a match occurs, it does not 
issue the command to the controller but instead 
substitute the alternative location as the new command. 

Apart from the much higher speed of the solid- 
state disk, another advantage is the lack of mechanical 
parts. The long seek times, rotational latency inherent 
in disk drives are not present. In addition, the long 
synchronization times, sync mark detects and write gaps 
are not required. Thus the overhead needed for 
accessing the location where data is to be read or 
written is much less. All of these simplifications and 
lack of constraints result in a much faster system with 
much reduced overheads. In addition, the files can be 
arranged in memory in any address order desired, only 
requiring the controller to know how to get at the data 
as needed. 

Another feature of the invention is that defect 
mapping is implemented without the need to interrupt the 
data stream transferred to or from the sector. The data 
in a block which may contain errors are -transferred 
regardless, and is corrected afterwards. Preserving the 
sequential addressing will result in higher speed by 
itself. Further, it allows the implementation of an 
efficient pipeline architecture in the read and write 
data paths. 

Write Cache System 

Cache memory is generally used to speed up the 
performance of systems having slower access devices^ 
For example in a computer system, access of data from 
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disk storage is slow and the speed would be greatly 
improved if the data could be obtained from the much 
faster RAM. Typically a part of system RAM is used as 
a cache for temporarily holding the most recently 
5 accessed data from disk. The next time the data is 
needed, it may be obtained from the fast cache instead 
of the slow disk. The scheme works well in situations 
where the same data is repeatedly operated on. This is 
the case in most structures and programs since the 
10 computer tends to work within a small area of memory at 
a time in running a program. Another example of caching 
is the using of faster SRAM cache to speed up access of 
data normally stored in cheaper but slower DRAM. 

Most of the conventional cache designs are read 
15 caches for speeding up reads from memory. In some 
cases, write caches are used for speeding up writes to 
memory. However in the case of writes to system memory 
(e.g. disks), data is still being written to system 
memory directly every time they occur, while being 
2 0 written into cache at the same time. This is done 
because of concern for loss of updated data files in 
case of power loss. If the write data is only stored in 
the cache memory (volatile) a loss of power will result 
in the new updated files being lost from cache before 
25 having the old data updated in system memory (non- 
volatile) . The system will then be operating on the old 
data when these files are used in further processing. 
The need to write to main memory every time defeats the 
caching mechanism for writes. Read caching does not 
30 have this concern since the data that could be lost from 
cache has a backup on disk. 

In the present invention, a system of Flash 
EEprom is used to provide non-volatile memory in place 
of traditional system memories such as disk storage. 
35 However, Flash EEprom memory is subject to wearing out 
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by excessive program/erase cycles. Even with the 
improved Flash EEprom memory device as disclosed in co- 
pending U.S. patent applications, Serial No. 204,175 and 
one entitled "Multi-state EEprom Read and Write Circuits 
5 and Techniques," by San jay Mehrotra and Dr. Eliyahou 
Harari filed on the same day as the present application, 
the endurance limit is approximately 10 6 program/erase 
cycles. In a ten-year projected life time of the 
device, this translates to a limit of one program/erase 

10 cycle per 5 minutes. This may be marginal in normal 
computer usage. 

To overcome this problem, a cache memory is 
used in a novel way to insulate the Flash EEprom memory 
device from enduring too many program/erase cycles. The 

15 primary function of the cache is to act on writes to the 
Flash EEprom memory and not on reads of the Flash EEprom 
memory, unlike the case with traditional caches. 
Instead of writing to the Flash EEprom memory every time 
the data is updated, the data may be operated on several 

20 times in the cache before being committed to the Flash 
EEprom memory. This reduces the number of writes to the 
Flash EEprom memory. Also, by writing mostly into the 
faster cache memory and reducing the number of writes to 
the slower Flash EEprom, an additional benefit is the 

25 increase in system write throughput- 

A relatively small size cache memory is quite 
effective to implement the present invention. This 
helps to overcome the problem of data loss in the 
volatile cache memory during a power loss. In that 

3 0 event, it is relatively easy to have sufficient power 
reserve to maintain the cache memory long enough and 
have the data dumped into a non-volatile memory such as 
a specially reserved space in the Flash EEprom memory. 
In the event of a power down or and power loss to the 

35 system, the write cache system may be isolated from the 
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system and a dedicated rechargeable power supply may be 
switch in only to power the cache system and the 
reserved space in the Flash EEprom memory. 

Figure 8 illustrates schematically a cache 
5 system 701 as part of the controller, according to the 
present invention. On one hand the cache system 701 is 
connected to the Flash EEprom memory array 33. On the 
other hand it is connected to the microprocessor system 
(not shown) through a host interface 703. The cache 

10 system 701 has two memories. One is a cache memory 705 
for temporarily holding write data files. The other is 
a tag memory 709 for storing relevant information about 
the data files held in the cache memory 705* A memory 
timing/control circuit 713 controls the writing of data 

15 files from the cache memory 705 to the Flash EEprom 
memory 33. The memory control circuit 713 is responsive 
to the information stored in the tag memory as well as 
a power sensing input 715 with is connected through the 
host interface 703 via a line 717 to the power supply of 

20 the microprocessor system. A power loss in the 
microprocessor system will be sensed by the memory 
control circuit 713 which will then down load all the 
data files in the volatile cache memory 705 to the non- 
volatile Flash EEprom memory 33. 

25 In the present invention, the Flash EEprom 

memory array 33 is organized into sectors (typically 
512 byte size) such that all memory cells within each 
sector are erasable together. Thus each sector may be 
considered to store a data file and a write operation on 

3 0 the memory array acts on one or more such files. 

During read of a new sector in the Flash EEprom 
memory 33, the data file is read out and sent directly 
to the host through the controller. This file is not 
used to fill the cache memory 705 as is done in the 

35 traditional cache systems. 
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After the host system has processed the data 
within a file and wishes to write it back to the Flash 
EEprom memory 33 , it accesses the cache system 701 with 
a write cycle request. The controller then intercepts 
this request and acts on the cycle. 

In one embodiment of the invention, the data 
file is written to the cache memory 705. At the same 
time, two other pieces of information about the data 
file are written to a tag memory 709. The first is a 
file pointer which identifies the file present in the 
cache memory 705. The second is a time stamp that tells 
what time the file was last written into the cache 
memory. ;in this way, each time the host wishes t:o write 
to the Flash EEprom memory 33, the data file is actually 
first stored in the cache memory 705 along with pointers 
and time stamps in the tag memory 709. 

In another embodiment of the invention, when a 
write from the host occurs, the controller first checks 
to see if that file already existed in the cache memory 
705 or has been tagged in the tag memory 709. If it has 
not been tagged, the file is written to the Flash memory 
33, while its identifier and time stamp are written to 
the tag memory 709. If the file already is present in 
the cache memory or has been tagged, it is updated in 
the cache memory and not written to the Flash memory. 
In this way only infrequently used data files are 
written into the Flash memory while frequently used data 
files are trapped in the cache memory. 

In yet another embodiment of the invention, 
when a write from the host occurs, the controller first 
checks to see if that data file has been last written 
anywhere within a predetermined period of time (for 
example, 5 minutes) . If it has not, the data file is 
written to the Flash memory 33, while its identifier 
and time stamp are written to the tag memory 709. If 
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the data file lias been last written within the 
predetermined period of time, it is written into the 
cache memory 705 and not written to the Flash memory. 
At the same time, its identifier and time stamp are 
5 written to the tag memory 709 as in the other 
embodiments. In this way also, only infrequently used 
data files are written into the Flash memory while 
frequently used data f iles are trapped in the cache 
memory . 

10 in all embodiments, over time the cache memory 

7 05 will start to fill up* When the controller has 
deteicted that some predetermined state of fullness has 
been reached, it begins to archive preferentially some 
files over others in the cache memory 705 by writing 

15 them to the Flash memory 33. 

In either embodiments, over time the cache 
memory 705 will start to fill up. When the controller 
has detected that some predetermined state of fullness 
has been reached, it begins to archive preferentially 

20 some files over others in the cache memory 705 by 
writing them to the Flash memory 33. The file 
identifier tag bits for these files are then reset, 
indicating that these files may be written over. This 
makes room for new data files entering the cache memory. 

25 The controller is responsible for first -moving 

the least active files back into the Flash memory 33 to 
make room for new active files. To keep track of each 
file's activity level, the time stamp for each file is 
incremented by the controller at every time step unless 

3 0 reset by a new activity of the file. The timing is 
provided by timers 711. At every time step (count) , the 
controller systematically accesses each data file in the 
cache memory and reads the last time stamp written for 
this data file. The controller then increments the time 

35 stamp by another time step (i.e. increments the count by 
one) . 




Two tilings can happen to a file's time stamp, 
depending on the activity of the file. One possibility 
is for the time stamp to be reset in the event of a new 
activity occurring. The other possibility is that no 
new activity occurs for the file and the time stamp 
continues to increment until the file is removed from 
the cache. In practice a maximum limit may be reached 
if the time stamp is allowed to increase indefinitely. 
For example, the system may allow the time stamp to 
increment to a maximum period of inactivity of 5 
minutes. Thus, when a data file is written in the cache 
memory, the time stamp for the file is. set at its 
initial value. Then the time stamp will start to age, 
incrementing at every time step unless reset to its 
initial value again by another write update. After say, 
5 minutes of inactivity, the time stamp has incremented 
to a maximum terminal count. 

In one embodiment of keeping count, a bit can 
be shifted one place in a shift register each time a 
count increment for a file occurs. If the file is 
updated (a new activity has occurred) the bit's location 
will be reset to the initial location of the sliift 
register. On the other hand, if the file remains 
inactive the bit will eventually be shifted to the 
terminal shift position. In another embodiment, a count 
value for each file is stored and incremented at each 
time step. After each increment, the count value is 
compared to a master counter, the difference being the 
time delay. in question. 

Thus, if a file is active its incremented time 
stamp is reset back to the initial value each time the 
data file is rewritten. In this manner, files that are 
constantly updated will have low time stamp identifiers 
and will be kept in cache until their activity 
decreases. After a period of inactivity has expired, 
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they acquire the maximum time stamp identifiers. The 
inactive files are eventually archived to the Flash 
memory freeing space in the cache memory for new, more 
active files. Space is also freed up in the tag memory 
5 when these inactive files are moved to the Flash memory. 

At any time when room must be made available 
for new data files coming into the cache memory, the 
controller removes some of the older files and archives 
them to the Flash memory 33. Scheduling is done by a 

10 memory timing/control circuit 713 in the controller. 
The decision to archive the file is based on several 
criteria. The controller looks at the frequency of 
writes occurring in the system and looks at how full the 
cache is. if there is still room in the cache, no 

15 archiving need to be done. If more room is needed, the 
files with the earliest time stamps are first: removed 
and archived to the Flash memory. 

Although the invention has been described with 
implementation in hardware in the controller, it is to 

2 0 be understood that other implementations are possible. 

For example, the cache system may be located elsewhere 
in the system, or be implemented by software using the 
existing microprocessor system. Such variations are 
within the scope of protection for the present 
25 invention. 

The Profile of how often data is written back 
to the Flash memory is determined by several factors. 
It depends on the size of the cache memory and the 
frequency of writes occurring in the system. With a 

3 0 small cache memory system, only the highest frequency 

files will be cached. Less frequently accessed files 
will also be cached with increasing cache memory size. 
In the present invention, a relatively cheap and small 
amount of cache memory, preferably about 1 Mbyte, may be 
3 5 used to good advantage. By not constantly writing the 
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most active files (the top 5%) , the write frequency of 
the Flash EEprom may be reduced from the usual one every 
millisecond to one every 5 minutes. In this way the 
wear-out time for the memory can be extended almost 
5 indefinitely. This improvement is also accompanied by 
increased system performance during write. 

Incorporating time tag into the write cache 
concept has the advantage that the size of the write 
cache buffer memory can be relatively small , since it is 

10 used only to store frequently written data files, with 
all other files written directly into the Flash EEprom 
memory. A second advantage is that the management of 
moving data files in and out of the write cache buffer 
can be automated since it does not require advanced 

15 knowledge of which data files are to be called next. 

The various aspects of the present invention 
that have been described co-operate in a system of Flash 
EEprom memory array to make the Flash EEprom memory a 
viable alternative to conventional non-volatile mass 

2 0 storage devices. 

While the embodiments of the various aspects of 
the present invention that have been described are the 
preferred implementation, those skilled in the art will 
understand that variations thereof may also be possible. 
25 Therefore, the invention is entitled to protection 
within the full scope of the appended claims* 



